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ABSTRACT • u 

The four studies reported in this document deal with 
aspects of assessing students* performance on computational skills. 
The first study grew out of a need for an instrument to measure 
students' speed at recalling addition facts. This had seemed to be a 

very easy task, but it proved to be much more difficult than 

anticipated. The second study grew^^out of a need to develop a test of 
addition and subtraction which w^a&''l)b*h machine scorable and not 
multiple choice. The study reported here .comparos a new response 
format to t;^o other response formats. The third study deals with the 
question of item ordering on tests. The study concerns tests with 
items ordered from easiest to hardest, hardest to easiest, and 
randomly, and how item ordering interacts with student aUxiety 
levels. The fourth study deals with three remedial methods of 
instruction for students at the second-grade level who were unable to 
perform two-digit addition with regrouping. One method used the 
mini-calculator as an aid, the second used a partial sums approach, 
and' the third the traditional regrouping method. (Author/SD) 
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MISSION 

The mission of the Wisconsin Research and Development Center 
for Cognitive Learning is to help learners develop as rapidly 
and effectively as possible their potential as human beings ^ 
and as contributing members of society. The R&D Center is 
striving to fulfill thi^s goal by 

• conducting research to discover more cibout 
how children learn 

• developing improved instruqt^ipnal strategies, 
processes and materials for school administrators, 
teachers, and children, and 

• offering assistance to educators and citizens 
which will help transfer the outcomes of research 
and development into practice 

PROGRAM 

The activities of the Wisconsin R&D Center are organized 
around one unifying theme. Individually Guided Education. 

FUNDING 

The Wisconsin R&D Center is supported with funds from the 
National Institute of Education; the Bureau of Education for 
the Handicapped, U.S. Office of Education? and the University 
of Wisconsin. 
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ABSTRACT 



■•• This report documents four brief studies. Each deals with an aspect 
of assessing pupil performance on computational skills. 

Study 1: Preliminary Development of an Oral 
Speed Test for Arithmetic Facts 

Speed of recalling computational facts has long been considered a pre- 
requisite to learning algorithms. However, research does not exist to confirm 
or deny this contention. There is not even a reliable procedure for ascer- 
taining speed of factual recall. This study reports initial efforts to develop 
an oral speed test for addition facts. As a result, a reasonable instrument 
to measure speed of factual recall appears to be possible. 

Study 2: An Investigation of Three Different Response 

Formats for a Two-Digit Addition and Subtraction 
Test 

This study was designed to see if responses to an addition and sub- 
traction test administered via a new machine-scorable completion format 
(shade the circle) were as reliable as responses over a^ simple completion 
format or a multiple-choice format. The results suggest that the new format 
is a viable alternative for tests of computational algorithms. 



Study 3: The Effect of Test Item Ordering on the 

Performance of Children of Different Test 
Anxiety Levels 

The ordering of items and the effect on performance of children with 
different test anxiety levels was exeunined in this study. Three tests were 
constructed from the same set of items: Test A had items ordered from 
easiest to hardest, Test D from hardest to easiest, and Test M had items 
randomly ordered. Three test anxiety groups were determined using the test 
anxiety scale for children. Results failed to show significant differences 
in performance for either item ordering or for the anxiety level. However, 
somewhat higher means were consistent for the mixed order and the low anxiety 
groups. 




Study 4: A Comparative Study of Three Remedial Methods 
of Instruction for Two-Digit Addition with 
Regrouping at the Second Grade 

In this experimental study a group of second-grade students needing 
remedial instruction on the two-digit addition algorithm were randomly 
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assigned to three treatment groups: one utilizing the hand-held calculator, 
one using a sub-sums approach, and one using the traditional approach. All 
three methods produced increased achievement. The calculator method, how- 
ever, yielded the poorest results; the traclitional carrying method yielded 
the best. 
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INTRODUCTION TO THE FOUR STUDIES 



The four studies reported in this document deal with some aspect of 
assessing students* perfoinmance on computational skills. The studies are 
part of an ongoing program of research under the direction of Professors 
Thomas A. Romberg and J. Fred Weaver at the University of Wisconsin. The 
program gained impetus in 1973 when Professor Weaver directed a presession 
on algorithmic learning for the AERA Special Interest Group in Research in 
Mathematics Education. , 

The first study, titled Preliminary Development of an Oral Speed Test 
for Arithmetic Facts, grew out of a need for an instrument to measure 
students' speed at recalling addition facts. This had seemed to be a very 
easy task, but it proved to be much more difficult than anticipated. 

The second study grew out of^, a need to develop a test which was both 
machine scorcible and not multiple^ choice' and which was designed to ascertain 
students' ability to add and subtract. The study reported here compares a 
new response format to two other response formats. 

The third study deals with the questj^on of item ordering on tests. The* 
question was raised as to whether items should be ordered from easiest to 
hardest, hardest to easiest, or randomly. ^ The question was posed in terms of 
student anxiety levels. 

The fourth study deals with three remedial methods of instruction for 
^students at the second-grade level who were unable to perform two-digit 
addition with regrouping. One method used the mini-calculator as an aid, 
the second used a partial sums approach, and the third the traditional re- 
grouping method. 
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STUDY I 



PRELIMINARY DEVELOPMENT OF AN 
ORAL SPEED TEST FOR ARITHMETIC FACTS 



INTRODUCTION 

This report describes initial attempts to develop a valid and reliable 
measure of students' speed at recalling addition facts. This work is seen 
as a first step in a sequence of investigations into algorithmic learning. 
In particular, the material developed here will be used to examine the re- 
lationship between students' rate of response on basic arithmetic combina- 
tions (facts) and their learning of algorithms that use those basic combina- 
tions. 

Reseiarch has little to say concerning the relationship of students' 
speed on facts to their learning of algorithms. However, it is generally 
believed by teachers that rapid response rates by students on the basic 
facts are prerequisite to their learning the algorithms that employ the 
facts. The proliferation of "drill and practice" programs for use in the 
elementary school supports the contention that such response rates are 
highly valued instructional outcomes. The immediate concern of the 
Wisconsin Research and Development Center is the need to specify guidelines 
for the development of a "drill and practice" program for Developing Mathe- 
matical Processes (1973) . 

i 

Two studies related to the general problem are reported by Brownell 
(1953) and Wiles (1973). In a study of the effects of learning an algor- 
ithm for division by two-place numbers on constituent skills, Brownell ^ 
reported that practice with the complex skill had no single predictable 
result as far as proficiency in subskills was concerned. Wiles (1973).- 
studied the effects of sequence of instruction on the acquisition of 
addition and subtraction algorithms. Measures of pre-instruction and post- 
instruction rates of response with the basic addition and subtraction facts 
were included as part of the design. These measures showed no predictable 
effects on students' rate of responding to the basic facts as a result of 
six weeks' instruction on the algorithms; in fact, on three of the six 
measures students showed absolute decreases in their rate of responding. 
These studies relate to what might be called the "incidental drill" 
hypothesis. However, the question of the relative importance of students' 
speed on facts to their learning of algorithms that employ those facts is 
not answered. 

Thus, an investigation into the relationship between students' speed 
on facts and their. learning of algorithms was called for. For this pro- 
posed study addition facts and the addition algorithm were chosen because 
(1) children who do not know an addition algorithm probably do not know 
any other computational algorithms and (2) instructional packages that 
enable large proportions of a group of learners to master the addition 
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algorithm are readily ;0yailable and it should be possible to find children 
with a broad ability rUn'ge who vary widely in their rates of response to 
the basic facts and who do not know an adequate additional algorithm for 
two* or three-digit numerals. " - 

DETAILS OF THIS STUDY 

To carry out the proposed investigation, it was necessary to develop 
a valid and reliable way of measuring students' speed on addition facts. 
A previous measure (Wiles, 1973) was inadequate^ in two ways. First, it 
was a speed test that involved both addition and subtraction facts. Facts 
of both types were presented so that no more than two items of any type 
appeared consecutively. 

Second, the posttest revealed algorithmic interference characterized 
by the exanples in Figure I.l. 



6X1 15 6 / 



+8 



-9 -6 +4 15-9 = 6 



/^/ 01 /9 10 

Figure I.l. Examples of student work illustrating algorithmic 
interference. 



To avoid algorithmic interference it had seemed reasonable that the visual 
presentation of the facts in the vertical form would encourage students to 
treat basic facts like a problem that is efficiently solved by an algorithm 
However, as is apparent from the last example in Figure I.l, placing the 
facts item in a horizontal form did not prevent interference from occurring 
Thus, it was decided to ask the student to respond to oral stimuli and to 
record only the sum. 

Three different oral tape recordings were made with response booklets 
for students to record their answers. The first of the three tapes. Tape 1 
was piloted with a total of 13 third graders and 10 second graders. Data 
obtained from the response booklets and the observations of the test admin- 
istrator were used in designing the script for the second and third tapes. 
Tape 2A and Tape 2B. Another test, called the "three-form test," was then 
constructed. Each form of the three- form test presents the same items as 
Tapes 2A and 2B. 
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Specifications of Tape 1 



Tape 1 contains 7 sets of 10 addition facts read at 7 various time 
intervals (see Table I.l). Each set of 10 facts consists of 5 easy items 
and 5 difficult items. An easy item is defined as one where the indicated 
sum of 2 one-digit numbers (neither zero) is greater than 2, but less than 
10. A difficult item then is defined as one where the indicated sum of 2 
one-digit numbers is 10 or greater. Each of the: 7 sets of 10 items was 
randomly generated. Then the items were ordered subject to the following 
constraints: 

1. No more than 2 easy or 2 difficult items occur consecutively. 

2. No item occurs more than once in the 7 sets of 10 items. 

3. An item and its commuted form are not allow2d to occur within 
the same set of 10 items i - 

4. Each set of 10 items contains 4 indicated sums of the follow- 
ing characteristics: 

a. one item whose s\m is exactly 10, 

b. one item that is a double, such as 4 + 4, 

c. two items where one of the numbers to be added is 9. 

The 7 sets of items were read at time intervals as indicated in 
Table I.l and recorded on magnetic tape. The interval was measured from 

TABLE 1.1 

TIME INTERVALS FOR TAPE 1 ITEM BLOCKS 



Item Block 


Time Intervals in Seconds 


1 


15 


2 


15 


3 


10 


4 


8 


5 


6 


6 


4 


7 


10 



14 
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the beginning of the reading of one item to the beginning of the next item 
(or the command to stop) . . Then the time required to read the item was in~ 
eluded as part of the indicated interval. The script for Tape 1 is contained 
in Appendix A. 

The first block of items was intended simply to familiarize the 
children with the general format of the test and the task requirements. 
The last block of items was given at the slow rate of 1 per 10 seconds so 
that the children would finish the tape with a feeling 'of success. The 
second through the sixth blocks were given^ at progressively shorter inter- 
vals to find the speed at which the child could no longer produce correct 
responses. 

The purpose of Tape 1 was to measure the speed at which students can 
produce correct answers. Hence, a sxobject must have some means of deter- 
mining correct sums. The second 15-second interval block was intended as 
a power test measure of a student's ability to do this, the decreasing 
time intervals for blocks 3 through 6 were intended to identify differences 
in children's ability to do this rapidly. Of course, a child who has 
memorized all the facts should be able to produce answers much more rapidly 
than a child who must count out sums. 

The Pilot of Tape 1 

Tape 1 was administered to two 'groups oX third graders and one group 
of second graders in Fall 1972. All of the subjects were from a suburban 
school in a metropolitan school district in central Wisconsin. In addition 
to the tape, the children were also asked to work some two-digit addition 
problems to see if they had mastered an algorithm. The children were 
allowed all the time they wanted to complete the two-digit items. 

One of the third-grade groups was a selected group of 7 children 
identified by their teacher as of average or less than average mathematical 
ability. This group is referred to as III-M. The ether third-grade group 
of six children was identified by the same teacher as being of high mathe- 
matical ability. This second group is referred to as III-H. The second- 
grade children, referred to as group II, were a random selection of 10 
children from an intact second-grade class. 

Table 1.2 contains the data obtained from the pilot of Tape 1. The 
variable ANC measures student ability to find the sum of 2 two-digit 
numbers that do not require regrouping, and the variable AC measures 
student ability to complete such two-digit items that do require regroup- 
ing. The third-grade children, groups III-H and III-M, were asked to work 
10 items of eadh type. The second-grade^ children were asked to work only 
1 item of each type because they had received no formal instruction with 
two-digit algorithms. The data indicate that none of the second graders could 
add using regrouping but that 4 of the 10 could correctly complete an item 
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TABLE 1.2 
DATA FROM PILOT OF TAPE 1 



subjects 
by Group 






Numbers 


of Incorrect Items 


for Each 


Variable 




Two- Digit 
Algorithms 
ANC AC 


1 /I R 
1/ 1-> 


Tape Block/Time 
(easy items, 
2/15 3/10 


Interval in Seconds 
difficult items) 
4/8 5/6 6/4 


7/10 


III-H 




















BE 


0 


0 


0,0 


0,0 


0,0 


0,0 


0,0 


0,0 




AU 


2 


1 


0,0 


0,0 


0,0 


0,0 


0,0 


0,0 




E 


0 


0 


0,0 


0,0 


0,0 


0,1 


0,0 


0,0 




JL 


0 


0 


0,0 


0,0 


0>0 


0,0 


•0,1 


0,1 




NM 


0 


8 


0,0 


0,0 


0,0 


0,0 


0,2 


0,1 




DS 


0 


0 


0,0 


0,0 


0,0 


0,0 


0,0 


0,0 




III-M 




















or 


. 0 


9 


n n 


— 


0,2 


0,0 


0,3 


0,0 


0,0 


B 


0 


0 


0,0 


— 


0,0 


0,0 


0,0 


0,0 


0,0 


Ti 


0 


10 


0,1 


— 


0,0 


0,2 


0,0 


0,2 


0,0 


Am 


1 


10 


0,0 


— 


0,0 


0,0 


1,2 


0,0 


0,0 


Ot* 


8 


8 


0,1 


— 


0,2 


0,1 


0,0 


0,0 


0,0 


SB 


0 


9 


0,0 


— 


0,0 


0,0 


0,0 


0,0 


0,0 


Te 


0 


9 


0,0 


— 


0,0 


0,0 


0,0 


1,0 


0,0 


II** 




















JP 


No 


No 


0 , 0 


0,0 


0,0 


0,0 


0,1 


0,2 


0,2 


Be 


Yes 


No 


0/4 


0,1 


0,4 


0,2 


0,3 


1,5 


0,4 


Ch 


Yes 


No 


0,1 


0,4 


0,2 


0,3 


0,3 


1,2 


0,3 


Mi 


No 


No 


1,3 


1,2 


2,2 


0,3 


1,4 


0,2 


1,3 


Ro 


Yes 


No 


0,0 


0,0 


0,1 


0,0 


0,0 


1,0 


0,1 


Ji 


■\ No 


No 


0,0 


0,0 


0,2 


0,0 


0,3 


1,2 


1,1 


Gr 


No 


No 


0,1 


1,4 


0,2 


0,4 


1,3 


2,4 


0,3 


Ci 


No 


No 


0,3 


2,4 


0,3 


0,3 


3,4 


1,5 


2,3 


- 


Yes 


No 


2,1 


0,4 


1,3 


1,2 


2,4 


1,4 


0,0 


Su 


No 


No 


1,3 


3,4 


1,3 


1,3 


1,4 


4,5 


4,4 



*This subject counted his sums for ANC and AC using tally marks. 

**Group II attempted only one item for variables ANC and AC. 
"Yes" means it was correct and "No" means it was not. 
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that did not require regrouping. Only 1 of the third graders in the medium- 
low ability group knew an adequate algorithm while 5 of the 6 high ability 
third graders did. 

Tape 1 was administered first to group III-H, then to group III-M^ 
and finally to group II. During the administration of the tape to group 
III-H^ it was apparent that they were making very few errors. In fact, it 
was only during blocks 5 and 6 that they showed any concern at all about 
the time intervals. The subvject SU who missed 2 items for block 3 — the 10- 
second interval block — apparently did so because he was bored with the 
whole procedure. Rather than risk a complete loss of task focus by return- 
ing to the 10-second intervals of block 1 , it was decided to not play that 
block for these children. The performances of these children for the 
variables ANC and AG indicated that all but one of these children did pos- 
sess an adequate algorithm for the addition of two-digit whole numbers. All 
of these children demonstrated mastery with the facts as evidenced by their 
perfect scores for blocks 1 and 2. 

The subjects of group III-M also demonstrated mastery with the facts 
as demonstrated by the fact that only two of the subjects missed any items 
on the warm-up block "1, and- these children only missed one item each. 
Block 2 was not played for these children because of the loss of task focus 
that was observed during the administration of the tape to group III-H* The 
subjects of group III-M, however, still appeared to waver in their attention 
during the playing of block 3. One of the seven subjects of group III-M 
demonstrated knowledge of an adequate addition algorithm; he .also responded 
correctly to all of the items of each block. 

In spite of the fact that the third-grade groups III-H and III-M 
appeared to loose interest in the task during the course of blocks 1, 2, 
and 3, it was decided that the second graders of group II could be dif- 
ferent enough from the third graders to warrant an administration of all 
seven of the blocks- However, the experimenter noted that during the 
administration of blocks 1 and 2, the amount of time provided was obvi- 
ously longer than the children required to determine their responses. It 
was conjectured that dawdling between items was carried over into block 3, 
adversely affecting their scores for this block. The children became 
aware r however, as they worked on block 3, that less time was allowed per 
item, and they began to focus more sharply on the task. The data from 
group II indicated that only 4 of .the 10 subjects had mastered the ability 
to produce correct responses to the facts, and that none of the 10 children 
of group II knew an adequate addition algorithm for two-digit whole numbers. 

The subjects for whom this test was intended are children who have 
mastered the ability to produce correct sums to the basic addition facts, 
and who have either not mastered an addition algorithm or have only re- 
cently done so. A total of 11 subjects satisfied the criterion of mastery of 
the facts (80 percent correct) and failure to demonstrate knowledge of an 
adequate addition algorithm. - Table 1.3 contains the scores of these 11 
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subjects* Also included in Table r*3 are the data of' 2 group IL sxib- 
jects who demonstrated mastery of the facts from Tape 1, block: 1^ but not 
from Tape 1, block 2. 



TABLE 1.3 

SUBJECTS WHO MASTERED FACTS BUT NOT AN ADDITION ALGORITHM 



Subjects 
by Group 



Numbers of Incorrect Items for Each Variable 



Two- Digit 
Algorithms 



Tape Block/Time Interval in Seconds 
(easy items, difficult items) 





ANC 


AC 


1/15 


2/15 


3/10 


4/8 


5/6 


6/4 


7/10 


III-H 




















NM 


0 


8 


0,0 


0,0 


0,0 


0,0 


0,2 


0,1 




III-M 




















SF 


0 


9 


0,0 




0,2 


0,0 


0,3 


0,0 


0,0 


Ti 


0 


10 


0,1 




0,0 


0,2 


0,0 


0,2 


0,0 


Am 


1 


10 


0,0 




0,0 


0,0 


1,2 


0,0 


0,0- 


Ot 


8 


8 


0,1 




0,2 


0,1 


0,0 


0,0 


o.,o 


SB 


0 


9 


0,0 




0,0 


0,0 


0,0 


0,0 


0,0 


Te 


0 


9 


0,0 




0,0 


0,0 


0,0 


1,0 


o;o 


II 




















JP 


No 


No 


0,0 


0,0 


0,0 


0,0 


0,1 


0,2 


0,2 


Be 


Yes 


No 


0,4 


0,1 


0,4 


0,2 


0,3 


1,5 


n A 


Ro 


Yes 


No 


0,0 


0,0 


0,1 


0,0 


0,0 


1,0 


0,1 


Ji 


No 


No 


0,0 


0,0 


0,2 


0,0 


0,3 


1,2 


1,1 


Gr* 


No 


No 


0,1 


1,4 


0,2 


0,4 


1,3 


2,4 


0,3 


Ch* 


Yes 


No 


0,1 


0,4 


0,2 


0,4 


0,3 


1,2 


0,3 ■ 



*S\abjects with facts mastery on Block 1 but not Block 2* 



Table 1.4 contains the data ..<gG^ those subjects from groups III-H and 
III-M who demonstrated mastery of both the addition facts and an addition 
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algoritJhm. Since both the children who demonstrated Icnowledge of an addi- 
tion algorithm and the children who failed to do so were included in groups 
III-H and III-M, it se^ns reasonable to assume that the subjects who did 
evidence mastery of an algorithm had probably not mastered it long before 
the time of testing. Hence, the five subjects of group III-H and the one 
subject of group III-M are taken as representative of children who have 
recently mastered an addition algorithm. 



TABLE 1.4 

SUBJECTS WHO MASTERED BOTH FACTS AND AN ADDITION ALGORITHM 



Subjects 
by Group 






Numbers of 


Incorrect 


Items 


for Each Variable 




TwQ- Digit 
Algorithms 
ANC AC 


1/15 


Tape Block/Tiine Interval 
(easy items, difficult 
2/15 3/10 .4/8 5/6 


in Seconds 
items) 

6/4 7/10 


III-H 




















BE 


0 


0 


0,0 


0,0 


0,0 


0,0 


X),0 


0,0 


0,0 


SU 


2 


1 


0,0 


0,0 


. 0,2 


0,0 


0,0 


0,0 


0,0 


E 


0 


0. 


0,0 


0,0 


0,0 


0,1 


0,0 


0,0 


0,0 


JL 


0 


0 


0,0 


0,0 


0,0 


0,0 


0,1 


0,1 




DS 


' 0 


0 


0,0 


0,0 


0,0 


0,0 


0,0 


0,0 




III-M 




















B 


0 


0 


0,0 




0,0 


0,0 


0,0 


0,0 


0,0 



The' subjects who did not know an algorithm made few errors for the 
10- and 8-second interval blocks, with subjects frequently making better 
scores for the 8-second interval than they did for the 10-second interval. 
The subjects who' did know an algorithm (see Table 1.4) missed very few 
items at any rate of speed, with only one subject missing any item at the 
6- and 4-second intervals. 

There appeared to be an interaction between the easy and difficult 
items that resulted in perfoinnnance generally higher than might occur if 
all of the items had been either easy or difficult. It was common to 
observe a child who had not finished "counting up" before the next item 
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was read; the child would them dk> the next one If it were easy, and go 
back, to finish or recount: the difficult item. The greater speed at which 
sxabsequent items were introduced seemed to result primarily in greater 
concentration on the couaiting task. Although it was apparent that some 
of the childrea were respciiiding immediately with memorized responses, it 
was not felt that the test separated these children from those who simply 
increased their rate of counting for the combinations they had not memo- 
rized. 

Conclusions About T^e 1 

A major objective of an adequate facts speed test is that it sepa- 
rates those subjects who are responding from memory from those who must 
count to find the solution. It was decided that the test provided by 
Tape A was inadequate in this regard. It was further judged that the 
tape was too long for these subjects. It was decided that the data from 
blocks 1, 2, 3, and 7 indicated that 10-second intervals told as much 
about mastery of the facts (in terms of the ability to produce sums by 
counting, if necessary) as did the 15- second intervals. 

Design of Modified Instruments 

light of the above information two additional tape scripts were 
These were the sabne as Tape 1 with the following modifications: 

The number of blocks of 10 items was reduced from 7 to 5. 
The initial warm-up block was reduced to 5 items, 3 easy 
and 2 difficult, read at 8-second intervals instead of 10. 
The time intervals for the remaining 4 blocks were 8 
seconds, 5 seconds, 3 seconds, and 12 seconds, in that 
order. The last block was intended for use as a measure 
of facts mastery. 

In addition to the above modifications. Tape B was modified so that 
in each block of 10 items all five of the easy items were read first. The 
order of the items for Tape A was the same as for Tape 1. Both Tapes A 
and B were then recorded by the same reader as Tapel. A response booklet 
for use with Tapes A and B was also designed. A copy of this booklet is 
included in Appendix A. The response booklet contains a final section 
consisting of 8 two-digit addition items, four of which require , regroup- 
ing and four of which do not. 

In addition to developing Tapes A and B on the basis of information 
received from the pilot of Tape 1, three written test booklets were also 
designed. The test booklets all contain the same items as Tapes A and B, 
written in vertical form with a box in which the student will be asked to 
write his response. 



In 

written. 

1. 
2. 
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He is to "be further .instructed to write only in the box. The order 
of items is different for the three booklets. The first block of 5 items 
is identical for all booklets and is the same as the first block of Tape A. 
The second^ third, and fourth blocks of the three booklets consist of the 
blocks of Tape A, with the order of the blocks changed for the three test 
booklets. The last block consists of the same items as block 5 of Tape A, 
but the order of the 10 items within the block is changed for the 3 book- 
lets. The new orders for the last block are random under the constraint 
that no more than 2 easy or 2 difficult items occur in succession. A 
final section of 8 items is included in each of the test booklets consist- 
ing of 4 two-digit addition items that rec[uire regrouping and 4 that do not. 
The order of the items is random^ subject to the constraint that no more 
than 2 items of either type occur consecutively. The order of these items 
-is different for each of the 3 test booklets. Copies of the test booklets 
are included in Appendix A. These 3 forms, like Tapes A and have not 
as of this writing been administered to children. 

The obvious next step is the piloting of both the tapes and the book- 
lets. It is anticipated that a selection of one of these forms could then 
be made, and reliability estimates obtained for the selected test. 
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TAPESCRIPTS AND PROBLEM SHEETS 
FOR THE ORAL SPEED TESTS 
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TAPE 1 SCRIPT 
SPECIFICATIONS : 

I 

Narrator reading - 15,- 10, 8, 6, 4, 10 second intervals. 
SCRIPT : 

"Today we are going to see how quickly and accurately you can write 
sums. I will read a problem such as, 2 plus 3, and you are to write the 
sum, 5, on the line I tell you to. We will do one set of 10 items for 
practice." 

"Turn your booklet so that the numbe^ 1 is at the top of the page." 
( 15 second pause ) 

"Problem a, 2 plus 3." (Pause about 5 seconds.) "Since 2 plus 3 i 
5 you should write "5" on line a. Do not write, "2 plus 3", write only 
the 5."^ 

( 15 second pause ) 

"Problem b, 1 plus 7." (Pause about 10 seconds.) "1 plus 7 is 8. 

V 

Did you write 8 on line b? If not, do that right now. Do not write 1 
plus 7,; write the sum, 8, only." 

"We will pause for just a minute to be sure that you understand." 



beep - 5 second pause 

The administrators will check to be sure that 5 and 8 are written 
on lines a and b respectively. 



Lem, 



"We will now continue with Problem c through Problem j without stop- 
ping. For each of the problems you write the sum on the line of the problt 
Work as quickly as you can without making an errorT'^ Write only the sum, do 
not write the problem. If I read a problem so quickly you miss it, skip that 
line and wait for the next problem." 
(A bout 5 second pause .) • 

da 
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"Ready, begin." 
Problem c , 6-^6 
(15 second pause) 
Problem d , 2+9 
(15 second pause) 
Problem 4+3 
(15 second pause) 
Problem f , 4+9 

(15 second pause) 
Problem g , 3+8 

(15 second pause) 
Problem 5+1 

(15 second pause) 
Problem 2+8 

(15 second pause) 
Problem j , 7+2 

(15 second pause) 

"Now that was easy wasn't it? It's all right if you missed a few 
problems, because the purpose of this exercise is only to see how fast, 
you can write the sums asked for." 

( beep - followed by 5 second pause) 

"Now turn to the next page so you see the page with the number 2 at 
the top. (15 second pause.) Remember, do not write the problem, only the 
sum. Ready, begin." .f. 
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Problem 1 9 
(15 second pause) 
Problem 1-^7 
(15 second pause) 
Problem 1-^4 
(15 second pause) 
Proble m d , 7+6 
(15 second pause) 
Problem e , 4+5 
(15 second pause) 
Problem f , 3+6 
(15 second pause) 
Problem 5+8 
(15 second pause) 
Problem 6+1 
(15 second pause) 
Problem i , 9+8 
(15 second pause) 
Problem j , 5 + 3 
(15 second pause) 

"Turn to the next page with the number 3 at the top. (15 second pause 
The problems for this page, and the following pages, will be read a little 
faster. If you miss hearing a problem just skip it and wait for the next 
problem. Ready, begin." (Read at 10 second intervals.) 
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Problem a , 8 -^2 
(10 second pause) 
Problem h , 1+6 
(10 second pause) 
Problem 6+8 
(10 second pause) 
Problem d ^ 9+6 
(10 second pause) 
Problem e » 5+2 
(10 second pause) 
Problem f , 1+5 
(10 second pause) 
Problem g , 3+9 
(10 second pause) 
Problem h ., 5 + 4 
(10 second pause) 
Problem 1 , 3+3 
(10 second pause) 
Problem j , 7+4 
(10 second pause) 

"Turn to the next page with the number 4 at the top, (15 second pause.) 
These problems will be read a little faster. If. you miss hearinq a problem 
just skip it and wait for the next problem, Ready, begin.'* (Read at 8 second 
intervals.) 
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Problem a , 8+4 
(8 second pause) 
Problem b , 2+5 
(8 second pause) 
Problem c , 2+7 
(8 second pause) 
Problem d , 3+7 
(8 second pause) 
. Problem e , 9+2 
(8 second pause) 
Problem f , 1+2 
(8 second pause) 
P roblem 4+4 
(8 second pause) 
Problem 5+9 
(8 second pause) 
Problem 8+1 
(8 second pause) 
Problem j , 6+7 

(8 second pause) i; 

ij 

111 

"Turn to the next page with the numtiler 5 at the top. (15 second pause.) 
These problems will be read a little faster. Remember, if you miss hearing 
a problem, skip it and wait for the next problem. Ready, begin." (Read *^at 
6 second intervals.) 
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Problem 9+5 
(6 second pause) 
Problem 4+1 
(6 second pause) 
Problem c ^ 8+6 
(6 second pause) 
Problem d , 3+2 
' 16 second pause) 
Problem e ^ 7+1 
(6 second pause) 
P roblem f , 5+5 
(6 second pause) 
Problem g , 2+4 
(6 second pause) 
Problem h , 9+7 
(6 second pause) 
Problem 8+5 
(6 second pause) 
Problem j , 6+3 
(6 second pause) 

"Turn to the next page with the number 6 at the top. (15 second pause. 
If you miss hearing a problem just skip it and wait for the next problem. 
Ready, begin." (Read at 4 second intervals.) 
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Problem 2+6 
(4 second pause) 
Problem 4+7 
(4 second pause) 
Problem c , 1+8 
(4 second pause) 
Problem d ^ 3+1 
(4 second pause) 
Problem e ^ 9+4 
(4 second pause) 
Problem f , 5+6 
_(4 second pause) 
Problem g r 3+4 

(4 second pause) , 
Problem h , 9+9 

(4 second pause) 
Problem 4+6 

(4 second pause) 

Problem j , 4+2 

(4 second pause) 

"Turn to the next page with the number 7 at the top. (15 second pause.) 
These will be read much more slowly. Remember, if you miss hearing a problem 
just skip it and wait for the next problem. Ready, begin." (Read at 10 
second intervals.) 
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Problem a , 9+1 
(10 second pause) 
Problem 1+3 
(10 second pause) 
Problem c , 6+2 
(10 second pause) 
Problem d , 7+9 
(10 second pause) 
Problem e ^ 8+8 
(10 second pause) 
Problem f , 3+5 
(10 second pause) 
Problem q , 7+8 
(10 second pause) 
Problem 2+1 
(10 second pause) 
Problem 4+8 
(10 second pause) 
Problem j , 2+2 
(10 second pause) 

"Now, close your booklet. Than^c you very much for your help." 
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Find the following sums. 
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48 63 89 33 

+ 37 +3 +4 +2 



76 . 9 ^ 21 . 

+ 14 h 78 +17 +52 



8 3 43 1 8 

+ 25 + 44 + 7 + 78 



47 30 19 63 

+42 + 20 +19 +22 



33 60 6 20 

^ + 39 + 30 33 + 48 + 25 
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TAPES A AND B 

SPECIFICATIONS ; . ■ 

Narrator reading at 8, 5, 3, 12 second intervals following warmup 

at 8 second intervals. 
SCRIPT ; 

"Today w^^are going to see how quickly and accurately you can write sums, 
I will read a problem such as, 2 plus 3, and you are to write the sum 5 in the 

box I tell you to. Do not write 2 plus 3, write only the 5. We will do some 

••' ->• . ...^ . . 

problems for practice." 

"Look at your booklet. Make sure that the number 1 is at the top of the 

page." 

(8 second pause) ' 

^ "Problem a, 2 plus 3." Remember, write only the sum. (Pause about 5 seconds) 
"Since 2 plus 3 is 5, you should write "5" in box a. Do not write, "2 plus 3", 
write only the 5." 

(6 second pause) , 

"Problem b, 1 plus 7." (Pause about 8 seconds) "1 plus 7 is 8. Did 
you write 8 in box b? If not, do that right now. Do not write 1 plus 7; 
write the sum, 8, only." 

"We will pause for just a minute to be sure that you understand." 

beep - 5 second pause 



The administrators will check to be sure that 5 and 8 are written in boxes 
a and b respectively.- ^_ 



"We will now continue with Problem c through Problem e without stopping. 
For each of the problems you write the sum in the box for that problem. Work 
as quickly as you can without making an error. Write only the sum, do not 
write the problem. If I read a problem so quickly that you miss it,' skip tha' 
box and wait for the next problem." 
O (About 5 second pause.) 

ERIC . 
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"Ready, begin." 
Problem c » 6-4-6 
(8 second pause) 
Problem d, 2 + 9 
(8 second pause) 
Problem e, 4 + 3 
(8 second pause) 

•"'Stop and put your pencil down. Now that was easy wasn't it? It's all right 
if you missed a few problems, the purpose of this tape is only to see how fast 
you can %nrite the sums asked for." 

( beep - followed b^ 5 second pause . ) 

"Now turn to the next page. 

(8 second pause.) Remember, do not write the problem, only the sum. 
Ready, begin." 



(Tape A) 


(Tape B) 


Problem a, 1 + 9 


Problem a, 1+4 


(8 second pause) 


(8 second pause) 


Problem b, 7 + 7 


Problem b, 4+5 


(8 second pause) 


(8 second pause) 


Problem c, 1+4 


Problem c, 3+6 


(8 second paiise) 


(8 second pause) 


Problem d, 7 + 6 


Problem d, 6+1 


(8 second pause) 


(8 second pause) 


Problem e, 4 + 5 


Problem e, 5 + 3 


(8 second pause) 


(8 second pause) 
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(Tape A) 


(Tape B) 


Problai f , 3 ^ 6 


Problem f , 1 + 9 


(8 second pause) 


(8 second pause) 


Problem g, 5 + 8 


Problem g. 7 + 7 


(8 second pause) 


(8 second pause) 


Problem h, 6 + 1 


Problem h, 5 + 8 


(8 second pause) 


(8 second pause) 


Problem 1, 9 + 8 


Problem i, 7 + 6 


(8 second pause) 


(8 secon<3 pause) 


Problem j, 5+3 


Problem :i , 9 + 8 


(8 second pause) 


(8 second pause) 



"Stop, put your pencil down and turn to the next page. 

(8 second pause) The problems for this page, and^ the following pages, will be read 
a little faster. If you miss hearing a problem just skip that box and wait for 
the next problem. Ready, begin." (Read at 5 second intervals) 



ERLC 



(Tape A) 


(Tape B) 


Problem a, 8 + 2 


Problem a, 1 + 6 


(5 second pause) 


(5 second pause) 


Problem b, 1 + 6 


Problem b , 5> 2 


(5 second pause) 


(5 second pause) 


Problem c, 6 + 8 


Problem c, 1+5 


(5 second pause) 


(5 second pause) 


Problem d, 9 + 6 


Problem d , 5 + 4 


(5 second pause) 


(5 second pause) 


Problem e, 5 + 2 


Problem e , 3 + 3 


(5 second pause) 


(5 second pause) 


Problem f , 1 + 5 


Problem f , 8 + 2 


(5 second pause) 


(5 ,.se"]cond pause) 
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(Tape A) (Tape B) 

Problem g. 3+9 Problem g . 6 + 8 ♦ 

(5 second pause) (5 second pause) 

Problem h. 5+4 Problem h . 9+6 

(5 second pause) (5 second pause) 

Problem 1. 3+3 Problem 1 . 3+9 

(5 second pause) (5 second pause) 

Problem j . 7+4 Problem ^ , 7+4 

(5 second pause) (5 second pause) 

"Stop, put your pencil down and turn to the next page. 

(8 second pause) These problems will be read a little faster. Remember if you miss 
hearing a problem just skip that bo:x and wait for the next problem. Ready, begin." 
(Read at 3 second intervals). 



(Tape A) 


(Tape B) 


Problem a, 8+4 


Problem a, 2 + 5 


(3 second pause) 


(3 second pause) 


Problem b, 2 + 5 


Problem b, 1 + 2 


(3 second pause) 


(3 second pause) 


Problem c, 2 + 7 


Problem c, 2 + 7 


(3 second pause) 


(3 second pause) 


Problem d, 3 + 7 


Problem d, 4 + 4 


(3 second pause) 


(3 second pause) 


Problem e, 9 + 2 


Problem e, 8 + 1 


(3 second pause) 


(3 second pause) 


Problem f, 1 + 2 


Problem f , 3 + 7 


(3 second pause) 


(3 second pause) 
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(Tape A) 


(Tape B) 


Problem g, 4 + 4 


Problem g, 8 + 4 


(3 second pause) 


(3 second pause) 


Problem h, 5 + 9 


Problem h , 9 + 2 


(3 second pause) 


(3 second pause) 


Problem i, 8+1 


Problem i, 5 + 9 


(3 second pause) 


(3 second pause) 


Problem j, 6 + 7 


Problem j, 6 + 7 


(3 second pause) 


(3 second pause) 



"Stop, put your pencil down and turn to the ne^t page. Let's stop for a 
minute to relax before we do the rest of the problems. (Beep) (8 second pause) 
These problems will be read much more slowly. As before, write the answer only 
Remember, if you miss hearing a problem, skip it and wait for the next problem. 
Ready, begin." (Read at 12 second intervals). 



(Tape A) (Tape B) 



Problem a, 9 + 5 


Problem a, 4+1 


(12 second pause) 


(12 second pause) 


Problem b, 4+1 


Problem b, 3+2 


(12 second pause) 


(12 second pause) 


Problem c, 8 + 6 


Problem c, 7+1 


(12 second pause) 


(12 second pause) 


Problem d, 3 + 2 


Problem d, 2+4 


(12 second pause) 


(12 second pause) 


Problem e, 7+1 


Problem e, 6+3 


(12 second pause) 


' (12 second pause) 


Problem f, 5 + 5 


Problem f , 9 + 5 


(12 second pause) 


(12 second pause) 
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(Tape A) 

Problem g , 2+4 
(12 second pause) 
Problem h , 9+7 
(12 second pause) 
Problem i , 8+5 
(12 second pause) 
Problem j , 6+3 
(12 second pause) 



(Tape B) 

Problem g , 8+6 
(12 second pause) 
Problem h , 5+5 
(12 second pause) 
Problem i , 9+7 
(12 second pause) 
Problem J > 8 4-5 
(12 second pause) 



"Turn to the next page. (8 second pause,) Try to do all eight of these 
problems. You will have plenty of time to try them all. If you cannot do 
some problem, you may guess at an answer, Ox you may skip that problem. 
Thank you very much for your help." 
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STUDY II 

AN INVESTIGATION OF THREE DIFFERENT RESPONSE 



FORMATS FOR A TWO-DIGIT ADDITION AND SUBTRACTION TEST 



INTRODUCTION 



Although the most desirable format for assessing computational skills 
is a completion format, time and number of children frequently dictate the 
use of a machine-scorable test. One would like to be confident that the 
scores obtained on a machine-scorable test do not differ significantly from 
those scores obtained on a completion test. 

The most commonly used machine-scorable test format is multiple choice. 
The disadvantages of multiple-choice format follow: 

1. The child must read through a list of choices until he comes 
to the correct choice; this may tend to increase the length 
of the testing period. 

2. Many young children are confused when faced with a variety 
of choices. 

3. It is possible for children to guess the correct solution. 
Thusl^a score for this child does not necessarily indicate 
mastery of the behavior being assessed (Anastasi, 1968). 

4. Unless the choices include the distractor "none of these," 
a child has a clue that he has made an error when his 
solution is not included in the choices. i 

5. The format frequently prohibits the test's bei|ng used for 
diagnostic purposes. However, it is possible |to include 
the mast common type of errors as choice and thus the test 
couid serve as a diagnostic instrument. : 

In spite of the preceding disadvantages, the obvious advantages of a machine^ 
scorable test (scoring can be done less expensively, more accurately, and in 
less time than for hand-scored tests) explain the popularity of the multiple- 
choice format (Bloom at al., 1971). Therefore, it would seem that some 
attention should be given to investigating other machinfe-scorable formats 
which, hopefully, avoid the shortcomings of the multiple-choice format. This 
study examined one of these alternatives. 

DETAILS OF THIS STUDY 

The purpose of the study was to determine if the response format for 
a 30-item two-digit addition and subtraction test affected the score. The 
formats included were as follows: 
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1. Completion (hand-scored) - 

2. Multiple choice (machine- scored ) • 

3. Shade the circle (machine-scored). 

All three formats are described in detail in the following section., 



Materials 



Three response formats were constructed for a 30-item 2-digit addition 
and subtraction test in which two-thirds of the items involved regrouping; 
cill formats used the same items in the same order. The formats were as fol- 
lows: 

1. Completion. This format consisted of 15 addition problems on 
one page and 15 subtraction problems on another page. The 
child was asked to find the sums and differences and to record 
his response below the item. (Form 1) 

2. Multiple choice. This format provided four choices for each 
item, one of which was "none of these." (Form 2) 

3. Shade the circle. The format of the items consisted of an 
addition or subtraction problem with-a three-column grid 
adjacent to it. The child was expected to compute the 
solution and then shade the circle in^-the appropriate column 
corresponding to the digits in his or her solution. 
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In the example, the child would have shaded 6 in the right- 
hand column and 5 in the middle column. To assist the child 
in selecting the correct column and the correct digit within 
the column, space was provided above the columns for the 
child to record his or her solution; all three practice exer- 
cises included this step. (Form 3) 

The test forms are included in Appendix B. 



Procedures 



Sixty-one second-grade children in an elementary school in Madison, 
Wisconsin, were randomly assigned to three groups. Each group was admin- 
istered a form of the test. Forms 2 and 3, the machine-scorable formats, 
were administered by the authors of the study; Form 1 was administered by 
a classroom teacher. 



Results 



Table II. 1 lists the observed means and Hoyt reliabilities for each 

form. 



TABLE II. 1 
OBSERVED MEANS AND HOYT RELIABILITIES 



Mean Hoyt 
Format Numbers (30 items) Reliabilities 



Completion 19 17.79 

Multiple Choice 21 16.90 

Shade the Circle 21 18.86 



.83 
.88 
.94 



Two nonindependent comparisions were made: multiple choice versus 
completion and shade the circle versus completion. The results of the 
tests are shown in Table II. 2. 
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TABLE II. 2 

TESTS ON DIFFERENCES BETWEEN PAIRS OF MEANS 



Comparison df MS F Significance 

Multiple Choice vs. 1 7.8076 .2725 p<.6037 
Completion 

Shade the Circle vs. 1 11.3707 .3969 p. < .5312 

Completion 



AS shown by Table II. 2, the differences between the pairs of means can clearly 
be attributed to chance. As expected, the analysis of variance summary, pre- 
ited in T^le JI.3, shows that the overall F ratio was not significant. 



sent 



TABLE I I. 3 
ANALYSIS OF VARIANCE SUMMARY 



Source of 
Variation 


df 


MS 


F 


Significance 


Between Formats 


2 


20.0666 


.7005 


p < .5005. 


Error 


58 


28.6472 







Discussion 



The study showed that for this group of children, the test format did 
not influence the score on a 30- item 2-digit addition and subtraction test. 
In particular, the shade-the-circle format, which incorporates all the ad- 
vantages of a machine- scorable test as well as the diagnostic advantages of 
a completion test, yielded a mean score not significantly different from 
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that obtained on the completion test* The authors believe that it 
is reasonable to assume that similar results — no significant difference 
between completion and shade-the-circle test formats—would be obtained 
on any test of computational skills- Thus, if a machine-scorable test 
is desired and the capability of processing the shade-the-circle test 
exists, then the shade-the-circle format provides a viable alternative 
to the multiple-choice format. 
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Appendix B 
THE ADDITION AND SUBTRACTION TESTS 
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Name 

Teacher 



Form 1 



© 197]5 - The Regents of the University of V/isconsin System for the V/isconsin 

Research and Development Center Tor Cognitive Learning. 
Copyright Is claimed only during the period of development, test, and e'v^iluation , 
unless authorization is received from the National Tnstiluue of Education to 
claim copyright on the final materials. Fi'or the current copyright status, contact 
either the copyright proprietor^or the National Institute of Education. 
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Find the Sum 
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?3 
+ 45 



37 
+ 56 



?5 
+ 49 



1 Q 



+ 50 



29 

+ 58 



6ft 
+ 17 



45 
+ 7 



52 
+ 37 



66 
+ 19 



36 

+ 35 



12 

+ 14 



75 
+ 18 



48 

+ 6 



35 
+ 24 



37 

+ 44 
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Find the Difference 

58 92 85 77 67 

- 23 - 37 - 59 - 52 - 49 



45 52 39 66 93 

- 27 2 8 - 16 - 27 - 68 

I 

87 73 70 68 51 

- 77 - 46 - 28 - 42 " - J6 
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Name Form 2 



Teacher 
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Research and Development Center for Cognitive Learning. 
Copyright is claimed only during the period of development, test, and evaluation ^ 
unless authorization is received from the National Institute of Education to 
claim copyright on the final materials. For the current copyright status, contact 
either the copyright proprietor or the National Institute of Education. 
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Example A 



25 0 26 

+ 3 0 29 

• 28 

0 none of these 



Example B 



37 0 49 

12 0 26 

0 35 

0 none of these 
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Find the Sum 



23 0 
+ 45 0 



68 
67 



37 0 83 
+ 56 0 93 



0 69 

0 none of these 



0 84 

0 none of these 



25 0 
+ 49 0 



65 
64 



18 0 48 
+ 50 0 58 



0 74 

0 none of these 



0 68 

0 none of these 



29 0 
+ 58 0 



87 
77 



68 0 75 
+ 17 0 85 



0 71 

0 none of these 



0 71 

0 none of these 



45 0 52 
+ 7 0 42 
0 
0 



52 0 90 
+ 37 0 85 



53 

none of these 



0 89 

0 none of these 
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Find the Sum 



66 0 75 

+ 19 0 85 

~ 0 76 

0 none of these 



36 0 71 

4- 35 0 61 

0 62 

0 none of these 



12 0 22 

+ 14 0 25 

0 26 

0 none of these 



75 0 83 
+ 16 0 93 



0 82 

0 none of these 



48 0 42 

+ 6 0 44 

0 54 

0 none of these 



35 0 11 

+24 0 49 

0 59 

0 none of these 



37 0 71 

+ 44 0 73 

0 81 

0 none of these 
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Find the Difference 



67 



58 0 71 

- 23 0 35 

* 0 36 

0 none of these 



92 
37 



0 65 

0 55 

0 66 

0 none of these 



85 0 26 

59 0 34 

0 36 

0 none of these 



77 0 22 

- 52 0 24 

0 25 

0 none of these 



67 0 18 

49 0 28 

0 22 

0 none of these 



45 
27 



0 22 

0 18 

0 28 

0 none of these 



52 0 46 

8 0 54 

0 44 

0 none of these 



39 
16 



0 23 

0 45 

0 13 

0 none of these 
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Find the Difference 



66 0 41 

- 27 0 49 

0 39 

0 none of these 



93 0 35 

68 0 25 

0 36 

0 none of these 



87 0 11 

77 0 10 
0 1 

0 none of these 



73 0 27 

46 0 33 

0 37 

0 none of these 



70 0 58 

28 0 42 

0 52 

0 none of these 



68 0 25 

42 0 24 

0 26 

0 none of these 



51 0 15 

36 0 25 

0 26 

0 none of these 
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^'^^^ - Form 3 

Teacher 



(c) 1973 - The Regents of the University of Wisconsin System for the Wisconsin 

Research and Development Center for Cognitive Learning. 
Copyright is claimed only during the period of development, test, and evaluation, 
unless authorization is received from the ITational Institute of Education to 
claim copyright on the final materials. For the current copyright status, contact 
either the copyright proprietor or the xNational Institute of Education. 

75 



70 



Example A 

25 

+ 3 

ri8 



1 y ^ 
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Example B 
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Example C 

35' r~~j 1 
+ 21 . ; ! i 

© © ©"' 
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Find the sum. 
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+ 45 
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Find the sum, 



29 

+ 58 



1 
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+ 17 
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52 
+ 37 



78 



© 0 0 

0 0® 

© © © 

0 © © 

© 0 0 

0 0 © 

00 0 

0 0 0 

0 0 0 
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Find the sum. 
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Find the sum. 

I — r— t — I 

48 i ! i 
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0 00 

.^0 0 0 
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Find the difference. 
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Find the difference. 
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Find the difference. 
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STUDY III 

THE EFFECT OF TEST ITEM ORDERING ON THE 
PERFORMANrE OF CHILDREN OF DIFFERENT TEST ANXTeTY LEVELS 



INTRODUCTION 



Both school systems and teachers require administration of a great 
number of examinations of various forms — both teacher-made and commer- 
cially produced tests--to assess children's achievement and progress. 
The value of the results of such tests (in terms of their validity) is 
dependent upon, among other factors, the conditions under which they are 
administered and their actual construction. The latter encompasses in- 
ternal structure — in particular, the idea of sequencing test items 
according to their difficulty levels. The authors' interests led them 
to investigate item ordering in mathematics examinations — specifically 
in computation- type exercises likely to be presented to elementary 
school pupils. 

Much interest and concern exists among educators about providing for 
individual differences in learning situations. It seems, however, that 
insufficient attention has been devoted to discovering and implementing 
means for providing for individual differences in evaluation and testing 
procedures. While attempts are made to match content and method to 
pupils' individual needs, too often only one set of criterion measures 
is applied for evaluation purposes. The present study was designed to 
take into account one such difference, namely, the amount and "level" of 
test anxiety in individual school children. 

Children evidence anxiety over tests at an early age. Some degrees 
of anxiety affect individuals' achievement positively, some negatively. 
Investigations dealing with the effect of test anxiety on a child' s per- 
formance on arithmetic tests date back several years (Jersild, Goldman, & 
Loftus, 1940). The existence in fifth- and sixth-grade children of exces- 
sive concern about failing a test was noted in their study. Angelino, 
Dollins, and Mech (1956) found that fears associated with school increased 
between ages 9 and 12, decreasing thereafter. In that same year, Castaneda, 
Palermo, and McCandless (1956) studied high and low test anxious fifth-grade 
children on easy versus difficult -con^onents of a conqplex learning task, 
noting a statistically significant interaction between anxiety and test 
complexity. - — 

The intent of the present study was to explore the performance of high, 
intermediate, and low test anxious fifth-grade children on three different 
orderings of item difficulty (ascending, descending, and mixed) of an arith- 
metic confutation examination. The null hypotheses of the study are formu- 
lated below: ^ 
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1. No significant difference in the mathematics test scores 
will be observed between test anxiety levels. 

2. No significant difference in the mathematics test scores 
will be observed between different fomiats of the exami- 
nation. 

3. No significant interaction between test anxiety level and 
ordering of examination items will be observed. 

DETAILS OF THIS STUDY 



Siibjects 

Fifty-three students in two fi^^h-grade classes in a rural public 

elementary school in Albany, Wisconsin were selected as the sample for 
the study . 



Procedure and Design 

During the^ -first week o$_ the experiment, Sarason's Test Anxiety Scale 
for Children (TASC) (Sarason, Davidson, Liglithall, & White, 1958) was 
administered separately to each class by. one of the authors. The class %. 
teachers were not present in their classrooms while the scale was adminis- 
tered. 

The authors concur with Sarason that the high test anxious child is 
one who- "experiences the test and test-like situations as markedly un- 
pleasant, tinged with more or less vague feelings of uneasiness and bodily 
tension (Sarason, Lighthall, Davidson, Waite, & Ruebush, 1960, p. 11)." 
The main assumption embedded in his scale ijs that such anxious reactions 
form a conscious experience which the child can easily communicate to 
another person* 



In most of his studies, Sarason was concerned with about one-third of the 
subjects, labeling those students having the top 15 percent of "yes" 
responses^ as high test anxious and correspondingly classifying those 
students having the lowest 15 percent of "yes" responses as low test 
anxious. Due to the small number of Albany school subjects, however, the 
authors chose to include all students. An intermediate test anxiety clas- 
sification was thereby created. Scores on the TASC were divided into 



A "yes" response on the scale is interpreted as an admission of an ■ 
unpleasant experience. 
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thirds and classified as low (L) , intermediate (I) , and high (H) test 
anxiety groups^ as indicated in Table III.l. 

The mathematics computation part of the 1970 edition of the Metro- 
politan Achievement Test Battery was administered exactly one week after 
the students had responded^ to questions on the TASC. Instructions similar 
to those utilized in a standard testing situation were given orally by the 
teacher, who was, solely responsible for administering the examination. 

Preliminary to the actual administering of the Metropolitan test, 
three forms of the examination — each differing in the ordering of item 
difficulty — were constructed as indicated in Table III. 2. Difficulty 
of test items was based on their respective p~values. 

The forty questions in form A of the examination were ranked in 
ascending (easy to hard) order of difficulty. The very same items were 
placed in descending (hard to easy) order of difficulty in form D of 
the test. Items on form M were arranged in a mixed order of difficulty. 
To develop this test form, questions were first sorted into 2 groups, 
the first of which contained 21 test items v/hose p-values ranged from 
,60 to .90; the second of which included 19 questions whose p~values 
were markedly lower (.15 to .55). Questions were then randomly selected, 
alternating between the 2 groups. The order which resulted became the 
sequence of form M. The three forms (A, D, and M) of the computation 
test Were then randomly assigned to the subjects within each anxiety 
level (L, I, H) . 

Test booklets were marked using a student's assigned row and seat 
number (e.g., test booklet number 43 corresponded to the child who sat 
in the third seat of the fourth row) . The same seating information was 
provided by the student on his or her answer sheet for the previously 
administered TASC. This procedure readily provided the investigators 
with a complete seating plan of both classes. When the test was admin- 
istered, the teacher, who was informed about the test labeling technique, 
was asked to distribute the booklets , thus making sure that each child 
received the proper, pre-assigned test booklet. 

Only scores of those 50 pupils who took both the TASC and the 
mathematics test were used. Before ana yzing the data, 5 cases were 
discarded in order to use an equal cell 2-way ANOVA computer program, 
leaving data from 45 students (5 per cell) . The 5 cases that were 
dropped (from 4 cells) were those nearest the individual cell mean. 



A similar procedure was used by Walter Szetela in his study (1973) , 
"The Effects of Test Anxiety and Success/Failure on Mathematics 
Performance in Grade 8." 
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TBBLE III.1 
CLASSIFICATION OF ANXIETY TYPES 



Number of "yes" 
responses on TASC 



Number 
of Subjects 



Classification* 



0 
1 
2 
3 
4 
5 
6 
7 



3 
3 
2 
0 
0 
1 
2 
5 



L 
L 
L 



L 
L 



\ 16 subjects 



J 



8 
9 
10 
11 
12 
13 



14 

15 
16 
17 
18 
19 
20 
21 
22 
23 
24 
25 
26 
27 
28 
29 
30 



5 
1 
2 
6 
4 
0 



2 
2 
0 
1 
2 
2 
2 
1 
2 
0 
1 
0 
2 
0 
0 
0 
0 



^ 18 subjects 



H 
H 

H 
H 
H 
H 
H 
H 



) 17 subjects 



L = low test anxiety 

I .= intermediate test anxiety 

H ~ high test anxiety 
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FORMAT FOR TEST BOOKLETS 



83 



Difficulty Index 



Original 


Form A 


Form M 


Form D ! 


Original 


Form A 


Form M 


Form D 


1 


1 


13 


40 


.90 


.90 


.55 


.15 


2 


2 


7 


39 


.90 


* .90 


175 


.15 


3 


3 


29 


32 


.85 


.85 


.40 


.20 


4 


5 


20 


38 


.80 


.85 


.70 


.25 ... 


5 


4 


27 


37 


-85 


.80 


.'15 


.25 


6 


6 


12 


35 


.80 


.80 


.70 


.25 I 


7 


11 


30 


33 


.75 


.80 


.45 


-.25 


B 


7 


6 


28 


.65 


.75 


.80 


.25 


9 


9 


38' 


36 


.75 


.75 


.25 


.30 


10 


12" 


8 


34 


:65 


r70 


.65 


.30 


11 


s 20 


36 


26 


.80 


.70 


.30 


.30 


12 . 


8 


5 


31 


.70 


.65 


.85 


.35 


13 


10 


33 


29 


.55 


.65 


.25 


.40 


14 


14 


22 


30 


.65 


.65 


.65 


.45 


15 


15 


40 


27 


-65 


«65 


.15 


.45 


16 


18 


18 


24 


.60 


.65 


.65 


.45 


17 


22 


26 


23 


.60 


.65 


.30 


.50 


18 


16 


14 


21 


.65 


.60 


.65 


.50 


19 


17 


31 


13 


.60 


.60 


.35 


.55 


20 


19 


2 


25 


.70 


.60 


.90 


.60 


21 


25 


28 


19 


.50 


.60 


.25 


.60 


22 




10 


17 


.65 


.55 


.65 


.60 


23 


21 


34 


16 


.50 


.50 


.30 


.60 


24 


23 


15 


22 


.45 


.50 


.65 


.65 


25 


24 


37 


18 


.60 


.45 


.25 


.65 


26 


27 


11 


15 


.30 


.45 


.80 


: .65 


27 


30 


35 


14 


.45 


.45 


.25 


.65 


28 


29 


9 


10 


-.'23 - 


.40 


.75 


.65 


29 


31 


39 


8 


.40 


.35 


..15 


.65 


30 


26 


16 


20 


.45 


.30 


.60 


.70 


31 — 


34 


23 


12 


.35 


.30 


.50 


.70 


32 


36 


19 


9 


.20 


.30 


.60 


.75 


33 


28 


32 


7 


.25 


.25 


.20 


.75 . 


34 


33 


1 


11 


.30 


.25 


.90 


.80 


35 


35 


25 


6 


.25 


.25 


.60 


.80 


36 


37 


3 


4 


:3o 


.25 


.85 


.80 


37 


38 


24 


5 


^ .25 


.25 


.'45 


.85 


38 


32 


4 


3 


.25 


.20 


.80 \ 


.85 


39 


39 


21 


2 


.15 


.15 


.50 


^90 


40 


40 


17 


1 


.15 


.15 


.60 


.90 
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Results 

The grand mean on the mathematics computation test was 24.80 (out of 
a possible 40) . The mean for each treatment cell of the design is provided 
in Table III. 3. The means on the computation test for students in the high, 
intermediate, and low test anxiety levels are 23.47, 24.00, and 26.93 re- 
spectively . The means for students who took the test in which the items 
were arranged in descending, mixed, and ascending orders of difficulty were 
24.20, 26-20, and 24.00 respectively. Table III. 4 contains the two-way 
analysis of variance for scores on the TASC and the computation test. 

TABLE III. 3 
CELL MEANS 



Mathematics 
Computation 
Test Form 


High 


Text Anxiety 
Intermediate 


Level 

Low 


Total 


D 


24.00 


24.40 


24.40 


24. 20 


M 


25.00 


23.20 


30.40 


26. 20 


A 


21.40 


24.40 


26.20 


24-00 


Total 


23.47 


24.00 


26.93 


24.80 



TABLE III. 4 
ANALYSIS OF VARIANCE SUMMARY 



Sources 


Sum of 
Squares 


Degrees 
of Freedom 


Mean 
Squares 


F ratio 


Anxiety Levels 


104,533 


2 


52,267 


1.364 


Test forms 


44,400 


2 


22,200 


.579 


Interaction 


95,066 


4 


23,767 . 


.620 


Error 


1,379,200 


36 


38,311 




Total 


1,623,200 


44 
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The F statistics for the effect due to' the level of test anxiety 
as well as to the ordering of questions on the mathematics computation 
test were not significant at a = .05 (p < .025). Th'e F statistics at ' 
a = .05 were not significant for the interaction of the text anxiety 
levels and the mathematics test item *orderings . On the basis of these 
results, none of the three previously stated null hypotheses can be 
rejected. 

In general, students who took the 'mixed form of the mathematics 
test tended to score higher than those who did not. This trend was 
somewhat constant across test anxiety levels. Low test anxious chil- 
dren seemed to perform better on the mathematics test when compared to 
their peers. This trend was constant across the three forms of the 
examination. The highest cell mean was obtained from low test anxious 
students who took the mixed form of the examination. 

Discussion 



Low test anxiety seemed to have a rather facilitating effect on the 
mathematics test performance of the children. That students who took the 
mixed form of the examination scored higher than their classmates may be 
attributable to the possibility that such item difficulty sequences are 
more intellectually arousing or provoking than the other two forms. It 
is surprising that there is very little difference between the means 
obtained from students who took form A and those who took form D of the 
test. No explanation for this occurrence is offered. 

The statistically non-significant results of the study may have been 
due to the small number of subject^s in each cell (n = 5) . Perhaps with a 
slightly larger sample, different outcomes and trends would have been ob- 
served. Another point of particular concern to the authors relates to 
classification of students into high, intermediate, and low test anxiety 
groups. Cut-off point — in particular, the one between low and interme- 
diate test anxious subgroups — were not very distinct. Although 30 
students scored below and 20 pupils performed better than the mean on the 
mathematics computation test, overall results were not strikingly unique 
(see Figure III.l). The^distribution of scores was positively skewed. 

Studies of this nature need to be replicated with a larger sample, 
possibly combined with different cut-off points and more precise instnoments 
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Number 
of 
Students 



17 — 
16 

15 — 

14 

13 

12 

11 

10 
9 — 
8 — 
7 

6 — 
5 — 
4 

3 ~ 
2 

1 — 



0 
X 
X 
X 
X 
X 
X 
X 



0 
0 
0 
0 
0 
0 
X 
X 
X 



0 
0 
0 
0 
0 
X 

24.8 

MEAN 



0 
X 



0 
0 
X 
X 
X 
X 



13-16 17-20 21-24 25-28 29-32 33-36 37-40 

V 

Figure III.l. Mathematics computation test scores. 



X = Form D 
0 = Form M 
* = Form. A 
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STUDY IV 

A COMPARATIVE STUDY OF THREE REMEDIAL METHODS OF INSTRUCTION 



FOR TWO-DIGIT ADDITION WITH REGROUPING AT THE SECOND GRADE 



INTRODUCTION 

This investigation deals with the remedial component of mathematics 
instruction* A variety of factors contribute to differences in xmder- 
standing of a given mathematical unit, and in the student achievement. 

One factor is the use of a method of instruction that does not take 
into account the student's capabilities or his learning style. In some 
Ccises a student learns in a "one track" way and his low achievement is due 
to a teaching method that does not match his way of learning. As Reissman 
says, 

A child may be slow because he learns in what I have called 
a "one tract" way; that is, he persists in one line of thought 
and is not flexible or broad. He does not easily adapt to 
other frames of reference, such as the teacher's, and conse- 
quently he may appear slow and dull (1962, p. 226). 

Other students have a learning style based primarily on a confron- 
tation with the immediate environment and, consequently, need to manipulate 
physical material in order to master a given skill or to grasp a given idea. 

According to Schulz, 

While the importance of visual and action-based mathematical 
experiences has been hypothesized on a neurological basis for 
all children, tactile experiences with objects and events are 
indispensable to the learner who has no other effective input 
channel. To form concepts and work mathematical problems, he 
needs the physical input provided by such manipulative materials 
as fraction pieces, Dienes blocks, geoboards, puzzles, games, 
machine calculators, and in fact the entire mathematics labora- 
tory (1972, p. 5). 

One reason given for the low achievement of many students is the 
stress on meaning in the present math programs. The assumption is that, 
if a student understands what he is doing, the skill will necessarily 
follow. Anderson (1949) investigated the effect of meaningful instruc- 
tion versus rote instruction on achievement, retention, and transfer of 
learning of fourth-grade students. He concluded that the meaning approach 
is suitable for students with high IQ's, while the rote method is -more ap- 
propriate for students with low IQ's, with some qualification. 

89 
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I^ter investigations indicate that, for. many children r understanding 
may come more appropriately after the acquisition of skills, and that this 
type of learning can be suitable for children with high IQ's as well as 
for those with low IQ's. Willoughby pointed to the results of these inves- 
tigations in the following terms: 

In fact it seems distinctly possible that, for many children/ 
understanding may come more appropriately after or during 
acquisition of the skills and of the ability to verbalize. 
Although there are many strongly held opinions on this siabject, 
there seems to be little clear evidence regarding which children 
should learn which mathematics in which ways (1970, p. 264). 

The effect of these considerations on instructional methods in general, 
and remedial instruction in particular, has given rise to several practical 
questions. Following are three of these questions: 

1. Should children receive remedial instruction within the 
same context under which they were initially instructed? 

2 . Are there motivating devices available which might make 
the task of remediation of skills easier? 

3. Should meaning and understanding be sacrificed at some 
point in favor of a rote approach to the instruction of 
computational skills? 

This study attempts to shed some light on the previous three ques- 
tions. It deals with the remediation of two-digit addition with regroup- 
ing in a second-grade setting, and investigates the following three 
approaches to remedial instruction: 

1. The use of a hand- held calculator to facilitate instruction. 

2. An approach that uses sub- sums." . 

3. The traditional carrying approach. ; 

DETAILS OF THE STUDY 

The procedure consisted of three parts: initial testing, instruction, 
and final testing. A description of each of these parts follows. 

Initial Testing 

The purpose of the initial testing was to identify those students 
who could profit from remedial instruction on two-digit addition with 
regrouping. The entire second grade (89 students) of the Zachary Lane 
Elementary School of the Robbinsdale Area Schpols in suburban Minneapolis 
received this testing. All students had received basic instruction in 
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two-digit addition with regrouping through expeinded notation progressing 
to the traditional carrying approach. The initial test cOTisisted of four 
parts u 

1. Ten teen facts. 

2. Five two-digit addition problems with no regrovqping. 

3. Five two-digit addition problems with regrouping. 

4. Five three-digit addition problems with regrouping. 

> 

Part 1 of the test was to identify those students who had basic fact 
problems, part 2 %ms to give additional information on these facts as well 
as a basic understanding of two-digit addition. Part 3 was intended to 
yive information on those students who could not perform two-digit addition 
with regrouping and could profit from the instruction. Part 4 was in- 
cluded in order to provide a safeguard for part 3 and, at the same time, to 
give initial information about eventual transfer. 

Five forms of the test were produced (see Appendix D) . Each of these 
forms consisted of problems randomly generated by a computer. The following 
ideal score pattern was expected: 

Part 1 Part 2 Part 3 Part 4 

10 correct 5 correct 0 correct 0 correct 

The tests were arranged^ so that students in each classroom used each 
of the five forms- The tests were distributed and si:»pervised by the class- 
room teachers - 

The results of the initial testing are given in Table IV. 1. 

TABLE IV. 1 

FREQUENCY DISTRIBUTION ON THE INITIAL TEST 



Part 


1 


Number correct 


10 


9 


8 


7 


6 


5 


4 


3 


2 


1 


0 






Frequency 


63 


9 


8 


3 


2 . 


2 


1 


1 


0 


0 


0 


Part 


2 


Number correct 




5 


4 


3 


2 


1 


0 














Frequency 




74 


11 


3 


1 


0 


0 










Part 


3 


Number correct 




5 


4 


3 


2 


1 


0 














Frequency 




44 


12 


2 


0 


1 


30 










Part 


4 


Number correct 




5 


4 


3 


2 


1 


0 














Frequency 




42 


12 


1 


1 


0 


33 
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Fifteen students whose scores approached the ideal score pattern 
were chosen; their scores are given in Table IV. 2. They were raiidomly 
assigned to three instruction groups so that each class was represented 
in each group., 

TABLE IV. 2 

SCORE PATTERNS ON INITIAL TEST 
OF CHILDREN IN INSTRUCTION GROUPS 



b uucien L. 


far u 1 


Part 2 


Part 3 


Part 4 


Group I-l 










1 


10 


5 


0 


0 


2 


10 


5 


0 


0 


3 


10 


4 


0 


0 


4 


10 


4 


0 


0 


5 


9 


5 


0 


0 


Group 1-2 










1 


10 


5 


0 


0 


2 


10 


5 


0 


0 


3 


9 


5 


0 


0 


4 


9 


5 


0 


0 


5 


8 


5 


0 


0 


Group 1-3 










1 


IP 


5 


0 


0 


2 


10 


5 


0 


0 


3 


10 


5 


0 


0 


4 


10 


5 


0 


0 


5 


10 


4 


0 


0 
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Instruction 

Instruction was carried out by an investigator over two periods, 
one of 30 minutes and one of 15 minutes, in the following way: 

First Group; The calculator method ^ 

The . instruction for this group was built around the use of hand-held 
calculators. It consisted of three parts: 

1. Introduction to the calculator 

2. Solving two-digit additions with regrouping using the calculator 

3. Solving two-digit ad^ditions with regrouping wiriiout the calculator, 
and then using the calculator to check the solution 

Second Group; The sub-sum method 

In this group, sub-sums were used as shown by the following example: 

Problem 27 Solution 27 

35 - 35 

12 
- 50 
62 

The instruction consisted of exploring with the students how the two 
sub-sums were generated and how the solution was obtained. 

Third Group: The traditional carrying method 

The instruction for this group is illustrated by the following 
example : 



Problem 27 Solution 
35 



27 

li 
62 



The students were told that 7_ + 5^ has to be considered first. The 
sum, 12 , is then broken into two parts — the 2_ is to be placed directly 
under the 7_ and 5^ in the ones position, and the 1_ is to be placed in the 
tens column. The tens can then be added, resulting in a sum of 62 . 

In the first group, interest in the use of the calculators was high. 
However, when the second phase began (solving problems and checking with 
the calculator) it was apparent that three children in the group were having 
trouble with basic number facts. It was also apparent that these students 
did not want to shift to phase two because of their success with using the 
calculator during phase one. ^ 
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The children in the second group expressed some disappointment because 
they could not use the calculator. Ihey experienced success in using the 
sub-sum approach. Two students in this group had some trouble with the 
basic facts, but not as severe as the students in the first group. 

The students in the third group were extremely happy solving problems 
using the traditional carrying method. They worked more problems as a group 
than either one of the previous two groups. They realized that their suc- 
cess was high and were content with this success. None of the children in 
this group had basic fact problems. The number of practice problems com- 
pleted by each child is shown in Table IV. 3. 



TABLE IV. 3 
NUMBER OF PRACTICE PROBLEMS COMPLETED 



student 


I-l 


Group 
1-2 


1-3 




1 


47 


57 


69 




2 


30 


98 


80 




3 


28 


36 


134 




4 


32 


14 


40 




5 


23 


16 


114 




Total 


160 


221 


437 





Final Testing 

The posttest was administered by the investigator to all of the students 
at the same time. This posttest took 20 minutes and consisted of two part^: 

1. Ten two-digit addition problems with regrouping 

2. Five three-digit addition problems with regrouping 

The problems were randomly generated by a computer (see Appendix C) . 
The results of the posttesting are given in Table IV. 4. 
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TABLE IV. 4 

NUMBER^OF CORRECT ANSWERS ON THE POSTTEST 



\ student Part One Part Two 

Group I-l 

1- , 9 1 

2 10 3 

3 3 0 

4 9 0 

5 4 0 
Group 1-2 

1 7 0 

2 10 0 

3 9 0 

4 6-0 

5 10 0 

Group 1-3 -~ 

1 . .10 0 

2 10 ' 5 

3 10 4 

4 10 5 

5 9 5 
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Results 



Table IV. 5 shows the mean and standard deviation of the part 1 score 
for each of the three groups. 



TABLE IV. 5 
POSTTEST MEANS AND STANDARD DEVIATIONS 







Mean 


Standard 
Deviation 


Group 


1 


7 


2.9 


Group 


2 


8.4 


1.62 


Group 


3 


9.8 


.4 



This table shows a marked trend in favor of method 3. It also shows 
method 2 favored over method 1. 

Table IV. 6 shows a one-way analysis of variance with a fixed effects' 
model of these scores . 



TABLE IV. 6 
ANOVA TABLE FOR POSTTEST SCORES 



Source dF SS MS 

Between Groups 2 19.6 9.8 



Within Groups 12 56 4.6 "^'^ 

Total 14 75.6 



'■^ = 2.12 
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Since the F2.12 statistics at the .1 level is equal to 2.81, the 
three methods of instruction do not differ significantly. 

It is obvious from Table IV. 4 that the third method yielded transfer 
to the three-digit addition problems with regrouping, while very little 
transfer was yielded by methods 1 and 2. 

RETENTION STUDY AND DATA 



It was decided that a retention test would shed more light on the 
data in Table IV. 4. 

This test was identical in number of problems and form to the final 
test and was administered exactly 11 days after the final test (see Appen- 
dix D) . It should be noted that a spring vacation period occurred in the 
interval between the two testings and no instruction took place during this 
period. The results of the retention testing are listed in Table IV. 7. 

TABLE IV. 7 

NUMBER OF CORRECT ANSWERS ON THE RETENTION TEST 



student Part 1 Part 2 

Group I-l 

1 6 0 

2 5 0 

3 3 0 

■4 8 5 

5 G O 

Group 1-2 

1 9 0 

2 10 0 

3 7 0 

4 4 0 

5 .10 0 



(continued on next page) 
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Table IV. 7 (Cont.) 



Student Part 1 Part 2 

Group 1-3 

15 0 

2 10 3 

3 10 4 

4 10 5 

5 9 4 



Results of the Retention Test 

Table IV. 8 shows the mean and standard deviation of the part 1 score 
for each of the three groups. 

TABLE' IV. 8 
RETENTION MEANS AND STANDARD DEVIATIONS 



standard 
Mean Deviation 



Group 


1 


4.4 


2.73 


Group 


2 


8 


2.28 


Group 


3 


8.8 


1.94 



Table IV. 9 shows a one-way analysis of variance with a fixed effects 
model of the scores on the retention test. 
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TABLE IV. 9 
ANOVA TABLE FOR RETENTION TEST SCORES 



Source DF 

Between Groups 2 
Within Groups *12 



SS MS F 

55 27.5 27.5 ^ 

81 6.75 ^ ' 



Since an F2 12 "^^ level of significance is 3.89, the scores 

of the three groups differ significantly. From the Table IV. 8 this dif- 
ference is due mainly to the low scores of the first group. As for the 
transfer of learning to the three-digit addition with regrouping, the 
retention test data are in accord with those of the posttesting. 



Discussion 



Table IV. 5 shows that the three methods used in the study can provide 
an increase in achievement in two-digit addition with regrouping. 

The use of hand-held calculators did not yield better achievement in 
the posttest than either methods 2 or 3. A similar result was obtained by 
Cech (1972) in a study conducted to investigate the effect of the use of 
desk calculators on attitudes and achievements with low-achieving ninth 
graders. Moreover, the results of the retention test show a significant 
difference in favor of methods 2 and 3. 

It is quite clear from the data that the traditional carrying method 
did transfer to three-digit addition with regrouping to a far greater de- 
gree than did either of the other two methods of instruction. Concerning 
the achievement, Wable IV. 4 shows a marked trend in favor of method 3. 
However, no conclusion can be drawn from this study about whether children 
should receive remedial instruction within the same context under which 
they were initially instructed. One reason for the failure to answer the 
previous question is that none of the students in Group 3 had troubles with 
the basic number facts, while three students from the first group and two 
from the second had such troubles. It is very probable that the background 
of the students has affected the achievement results. 
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It is the opinion of the investigators that the trend in favor of 
the third method could be attributed to the background of the students, to 
the method itself, or to the fact that the children's initial instruction 
was with this same method. A replication of the study might help elucidate 
this point. 



The instruction given did not stress any relationship between mean- 
ings and computations. A useful study might be undertaken to investigate 
the effect of rote instruction on subsequent understanding of the unresolved 
algorithms . 
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RETENTION TEST 



Name' 

ADD 



29 39 43 57 24 

+ 32 + 9 + 37 + 28 + 47 



36 27 43 28 42 

+ 49 + 45 + 37 + 29 + 18 



327 613 2 85 164 693 

117 '+219 +291 +353 + 1 5 8 



108 



105 

Name ^ 

Section 

ADD 



8 

+ 9 



9 

+ 2 



7 

+ 6 



9 

+ 3 



6 

+ 5 



4 

+ 9 



8 

+ 7 



5 

+ 7 



7 

+ 4 



7 

+ 7 



33 
+ 65 



41 

+ 32 



36 
+ 62 



53 

+ 20 



24 

+ 43 



29 
+ 32 



42 
+ 18 



15 

+ 65 



36 
+ 48 



49 

+ 33 



347 

+ 249 



747 

+ 238 



283 
+ 674 



455 
+ 271 



693 
+ 158 
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Name 

Sect ion 



ADD 



4 

+ 8 



6 

+ 7 



8 

+ 4 



4 

+ 9 



9 

+ 4 



9 

+ 2 



8 

+ 6 



9 

+ 5 



7 

+ 4 



8 

+ 9 



40 
+ 43 



32 
+ 64 



35 
+ 41 



45 

+ 44 



42 
+ 44 



28 
+ 29 



21 
+ 49 



39 
+ 9 



32 
+ 18 



28 
+ 49 



238 
+ 409 



469 
+ 322 



543 
+ 296 



164 

+ 353 



397 
+ 536 



i 
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Name 

Sect ion 

ADD 



8 

+ 6 



8 

+ 8 



8 

+ 7 



9 

. + 2 



4 

+ 8 



4 

+ 7 



8 

+ 9 



*- 9 
+ 4 



6 

+ 8 



8 

+ 3 



62 

+ 21 



35 
+ 30 



30 

+ 68 



72 

+ 13 



11 

+ 31 



17 
+ 46 



43 
+ 37 



16 

+ 65 



18 
+ 28 



38 
+ 49 



479 
+ 416 



324 
+ 358 



285 
+ 291 



322 
+ 184 



398 
+ 94 



111 



108 

Name 

Section 



ADD 



3 

+ 8 



8 

+ 5 



9 

+ 9 



5 

+ 6 



9 

+ 3 



9 

+ 5 



5 

+ 7 



8 

+ 5 



7 

+ 8 



6 

+ 7 



24 
+ 24 



38 

+ 11 



37 
+ 52 



20 
+ 27 



14 
+ 42 



+ 17 



64 

+ 16 



27 
+ 45 



57 
+ 28 



48 
+ 43 



613 

+ 



317 

+ 346 



433 
+ 376 



167 

+ 651 



788 

+ 187 



112 



109 



Name 

Section 



ADD 



8 

+ 8 



3 

+ 8 



8 

+ 7 



7 

+ 9 



5 

+ 6 



4 

+ 7 



7 

+ 8 



2 

+ 9 



3 

+ 8 



8 

+ 9 



35 

+ 24 



61 
+ 37 



23 
+ 46 



4 

+ 74 



84 

+ 13 



49 

18 



57 
+ 28 



76 
+ 17 



36 
+ 49 



24 
+ 47 



219 
+ 244 



327 
+ 117 



273 
+ 175 



642 
+ 162 



279 

+ 459 



1J3 



110 

Name 
ADD 



14 38 • 69 25 24 

+ 56 + 25 + 24 + 38 + 69 

35 39 47 54 ' 67 

+ 49 + 49 + 45 + 18 + 27 

■ ■- ' ■' ' - / — — — 

338 467 182 126 475 

+ 214 + 127 + 672 ,+ 582 + 327 
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